To annoy or infuriate someone.
It really gets my goat when inconsiderate people drop litter in public.